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APPARATUS AND METHOD FOR FUSION AND IN-OPERATING- 
ROOM PRESENTATION OF VOLUMETRIC DATA AND 3-D 

ANGIOGRAPHIC DATA 

BACKGROUND OF THE INVENTION 
5 FIELD OF THE INVENTION 

The present invention relates to medical imaging systems in general, 
and to an apparatus and method for presenting in-room, real-time updated 3- 
dimensional arteries rnodel, including plaque. 

10 DISCUSSION OF THE RELATED ART 

Medical imaging devices are widely used for a number of purposes, 
both prior to and during medical operations* Pre-Operation purposes include 
evaluation of a patient's status, assessment of required treatment, treatment 
planning in general and catheterization in particular. Dining-operation purposes 

15 include on-going assessment of the patient's condition, and locating the exact 
position of invasive tools and devices. 

Any currently existing imaging modality has its strengths and 
weaknesses. Angiograms have high resolution, which enables to depict small 
vessels (with diameter smaller than 0.8mm), unnoticeable in other modaUties. The 

20 high resolution of angiograms and three-dimensional products of angiograms 
processing, provide accurate measurements of distances, such as arteries 
diameter. Angiogramts are also up-to-date in nature. However, soft tissues are not 
visible in angiograms so a lot of information, and plaque information in particular 
is missing when coming to describe in details the current state of arteries. 

25 CT scanners, on the other hand, provide volumetric information and 

therefore offer 3-diirxensional presentation of segmented information, including 
soft tissues in gmexal and plaque deposited along the arterira in particular. 
However, CT scans lack up-to-date information, since they are taken prior to an 
operation. In addition, the resolution of CTs is inferior to the resolution provided 

30 by angiograms. 
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CT scans enable the reconstruction of the vessels structure by tracking 
the lumen, i.e., the space inside the arteries. The shortcoming of this constructionL 
is that if a blood vessel is blocked, little or no blood flows through it and th& 
relevant part of Uxo blood vessel can not be visually reached by tracking the 
lumen. In addition^ tiie blood vessels' walls can be viewed in CT scans provided, 
they are at least 1.5 mm wide (the width of a healtihy coronary artery, for 
example, is 10P-900|i). Therefore, it mi^t be unpossible to tell that a blood, 
vessel carries significant sediments until it is substantially damaged, or to assess 
the percentage of the steiiosis of the blood vessel. Using the standard tools, it is 
only posisible to tell if stenosis takes up more or less than 50% of the vessel's 
diameter. If the vessel wall is 2mm or greater, a more precise estimation of the 
percentage of the stenosis can be provided. 

There is therefore a need in the art for a system that will conibine the 
best of CT witli the best of angiograms to supply in-operatuig-room, up-to-date» 
accurate 3-dimensional information. 
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SUMMARY OF THE PRESENT INVENTION 
In accordance with a first aspect of the preset invention, there is 
provided an apparatus for displaying a first image, said first image is a product 
of processing a second image taken by a medical imaging device prior to a 
5 medical operation, the first image conq>rising information about areas having 
sediments, wherein during the operation, said Gist image is presented to a user 
of the system. The first image is fiised with a third image said third image is a 
product of processing a fourth image taken by a medical imaging device during 
the operation. The apparatus fiirther comprises a computer program for 
10 registration of images of the medical imaging devices; and fiising inforcnation 
contained in and associated with products of processing images of the medical 
imaging devices; and presenting the first or third or a combination of the first 
and third images containing information obtained from the medical imaging 
devices or an image containing information obtained fi-om the either one of the 
15 medical imaging devices. The apparatus also comprising a correction module 
to correct imaging errors in the second image, using the fourth image acquired 
during the operation. The imaging error is characterized by one or more 
calcified areas of one or more blood vessels depicted outsized on an image, 
said image is a product of processing of one or more images taken by one or 

20 more medical imaging device prior to an operatioiL In the preferred 
embodiment the first image and the third image, are presented on the same 
location on the visual display, where the first and the third images are partially 
transparent At least a part of the first image, and at least a part of the third 
image can be presented adjacent to each other. Sediments found by processing 

25 the first image are distinctively marked on the third image. The sediments 
found by processing the first image are distinctively marked on the first image. 
The apparatus fiirdier cpn^rising a marking module for marking one non- 
flexible part of tiie blood vessel, on the first or third image. The apparatus 
finther comprising a module for marking the at least one curved part of the 

30 blood vessel, on the first or third image. The apparatus fiuther comprises a 
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module for markuig indications prepared prior to the operation, on the first or 
third image. The apparatus further comprises a module for indicating during an 
operation, parameters determined prior to the operation, for a . medical imaging 
device, said parameters to be ^plied while taking uhages. The apparatus 
further comprises a module fon identifying one point in an image pres^ted 
during the operation with one or more check-points indicated prior to the 
operation; and presenting the image, associated prior to the operation with the 
one or more check-points^ The blood vessel can be a coronary artery. The 
sediments can be any one of the following: lipid-rich plaque, int^mediate 
plaque, calcified plaque, thrombi, cells or products of cells. The medical 
imaging device can be a multi slice computerized tomography device. 

In accordance with a second aspect of the present invention there is 
provided an apparatus for detecting a part of a blood vessel with sediments, 
fi-om a first image acquired by an imaging device pribr to an operation, tiie 
apparatus comprises: an identification module for identifying the part of the 
blood vessel, and within said part the sediments located therein; and a marking 
module for indicating the part of the blood vessel and sediment associated 
therewith on a second imiage created by processing images taken by a medical 
imaging device. The identification module is receiving intensity values for the 
pixel of the hnagQ acquired by a medical imaging device; and range of 
intensity values for the type of sedinient The ai^aratus further conq>nses a 
module for constructing a visual representation of the lumen of the blood 
vessel. The apparatus further comprising a module for constructing a visual 
representation of the part of the wall of the blood vessel The parts of the blood 
vessel and the sedintient submerged therein are indicated using color-coding. 
The apparatus further comprising a width determination module for 
determining Hxe width of the sedhnent layers at a location along a blood vessel; 
and the diameter of a bipod vessel at a location along the blood vessel; and the 
percentage of stenosis of a blood vessel at a location along the blood vessel. 
The widths of the sediment layers, the diameter of tiie blood vessel and the 
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percentage of stenosis are indicated on the second image. The apparatus further 
comprises a module for indicating, in response to a user action, a part of the 
blood vessel as non-flexible. The apparatus further enabling conqprises a 
module for indicating, in response to a user action, a part of the blood vessel as 
curved The apparatus fiirdier comprise a check-point definition module for 
indicating, in response to a usct action, a position within the body of a patient 
as a check-point and associate said check-point with the image produced by 
processing the fiurst image. The second image depicts a three-dimensional view 
of a part of the blood vesseL The second image depicts a surface within the 
human body and the blood vessel on said surface. The second image depicts an 
internal three-dimensional view of the blood vessel. The second image depicts 
a cross-section of a blood vessel at a location along the blood vessel, said 
cross-section comprising one or more of the following: tiie blood vessel's wall, 
tide lumen of the blood vessel, sediments submerged on the blood vessel's wall. 
The apparatus further comprises a module for manually correcting the 
indications for sediments on images acquired prior to an operation and the 
produ^ of said images. The correction includes changing the size or the 
sediment type of an indication, adding, or deleting indications. 

In accordance with a tiurd aspect of the present invention there is 
provided a method for displaying a first hnage, said first image is a product of 
processing a second image taken by a medical ima g ing device prior to a 
medical operation, the image comprising information about areas with 
sediments, during the operatioiL The first image is fused with a third image 
which is a product of processing a fourth image taken by a second medical 
imaging device during tiie operation, tite method con^mses the following 
steps: registering the coordinate systems of the first and second medical 
iinaging deviccs; and fusing information contained in and associated with 
products of processing itnages of the first or second medical imaging devices; 
and presenting an image firom the first or second medical imaging devices or an 
image containing information of images firom the first and second medical 
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imaging devices. The registration of the coordinate systems comprises the 
following steps: matching three or more points seen in images of the first and 
second medical iTnagiTig devices; and matching the coordinate fi:ames of the 
first and second medical imaging devices. The matching of the points is based 
5 on con^aring tibie coordinates of tiiree or more non-aligned fiducials as seen in 
the image of each of the two medical imaging devices. The matching of the 
three points is based on comparing an at least one two-diniensional image 
taken dming an operation to an at least one projection of a three dimensional 
image constructed firom at least two two-dimensional images taken by an at 

10 least one medical imaging device prior to tiie operation. The method further 
comprising a step of correcting an imaging error of the image taken by a 
medical imflging device prior to an operation, using Ihe image acquired during 
the operation. The imaging error is characterized by a calcified area of a blood 
vessel depicted outsized on one or more products of processing of the image 

15 taken by a medical imaging device prior to an operation. The registration of the 
coordinate systems comprises the following steps global registration of a first 
image and a second image taken by the first and the second medical imaging 
devices; and removal of local residual discrepancies by matching 
corresponding features detected in the first and the second images. The global 

20 registration is based on comparing die coordinates of a fiducial as seen in the 
first and the second images. The global registration is based on matching one 
or more two-dimensional images takai during an operation to a projection of a 
three dimensional data obtained firom the medical imaging device i)rior to the 
operationL The first image and the third image, are presCTted on the same 

25 location on the visual display, where the first and the third images are at least 
partially transparent The method further comprising a step of marking non- 
flexible part of a blood vessel, odl a first image. The method further comprising 
a step of rnarlring non-flexible part of a blood vessel, on the first image. The 
method further comprising a step of maikmg curved portion of the blood 

30 vessel, on first image. The method further comprising a step of ma rk in g curved 
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pordon of the blood vessel, on the third image. The method further comprising 
the steps of identifying a point in an image acquired during the operation with a 
checkrpoint indicated prior to the operation; and presenting the image 
associated prior to the opaiition with the check-point 
5 In accordance with a fourth aspect of the present invration there is 

provided a method for automatic reconstmction of a three-dimensional objects 
from two angiograms using CT information, the method comprises the 
following steps taking a first and a second angiograms of the required area 
from different perspectives; and for the first and the second angiogram, 

10 obtaining a first and a second projected CT images by projecting the three 
dimensional CT data on the same plane as the first and the second angiogram; 
and registration of the first and the second angiogram with the corresponding 
projected CT images by objects appearing in the angiogram and in the 
projected CT; and mutual co-registration of the first and the second 

15 angiograms; and detecting objects spearing in the angiogram and match with 
the corresponding objects in the projected CT; and deriving the three 
dimensional coordinates of the objects appearing in the first and the second 
angiograms; and constmcting a three dimensional image of the required area 
fix>m the first and the second angiogranL 

20 
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■4 

BRIEF DESCRIPTION OF THE DRAWINGS 
The pi^ent invention will be understood and appreciated more fully 
6om the following detailed description taken in conjunction with the drawings in 
whicli: 

5 Fig. 1 is a schematic block diagram of the proposed s^paratus, in 

accordance with the preferred raibodiment of the present invention; 

Fig. 2 is a schematic block diagram of the operating componeats of the 
pre-operation modules, in accordance with the preferred embodiment of the 
present invention; 

10 Fig. 3 is a schematic block diagram of the image fusion method; and 

Fig. 4 is a schematic block diagram of the operating con^>onents of the 
during-operation modules, in accordance with the preferred embodiment of the 
present iavention. 
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DETAILED DESCRffTION OF THE PREFERRED EMBODIMENT 

An ^paratus and method for fusing images and infbnnation about 
tubular organs, from CT scans and angiograms, and presentation of the same in 3- 
dimensions during medical operations is disclosed. The presented informatioh 
5 includes diflForeixt types of sedimCTits deposited inside and outside coronary 
arteries or other blood vessels, as part of the whole structure of the blood vessels. 
The apparatus is designed to be used both before and during a medical operation, 
usually a calheterization, and also to enable the user to mark different areas of 
interest and pre-defined views prior to the operation. The areas and views will be 
10 presented by the system during an operation. 

The preferred embodiment of this invention uses slices taken by a 
Multi-SUce Computerized Tomography (MSCT) device. The MSCT scaimer can 
simultaneously acquire up to 32, 40, or even 64 slices, thus covering the whole 
heart area by slices 0.6 mm apart, that were takoi during a time frame of 10-20 
15 seconds Thraefore, the scaimer enables high-resolution morphologic evaluation 
of the myocardixam and the coronary arteries as well as of other blood vessels. 
The MSCT yields a pixel size of 03-0.5mm and ten^oral resolution of 90- 
120mSec. 

Referring now to Fig. 1 that shows an exenq>lary CTvironmait in 
20 which the proposed apparatus and associated mediods are implemented. In flie 
present non-limiting example, the environment is a cardiologic department of a 
health care institute. A patient who is suspected (or known) to suffer from a 
coronary arteries problem, or another problem related to sediments on blood 
vessels, goes throu|^ a scanning session by a medical iniaging device. A possible 
25 conclusion of the physician evaluating the images taken by the device is that the 
patient should be catheterized. In this case, the proposed invention discloses how 
to fuse and present images taken or generated prior to the (^leration, with images 
taken or generated during the operation. When relating to images taken prior to or 
during an operation, the discussion includes both flie images as taken, and 
30 products of processmg the taken images. The products are model of different 


-9- 


wo 2006/033113 


.PCT/1L200S/001024 


body parts or body tissues, such as a vascular tree, a heart muscle, plaque or the 
like. The structures may be desoibed as collections of volume elements, tubular 
organs given by lines and radii, sur&ce and so on. The mentioned stmctures, of 
course, are associated with one or more visual presentations. 
5 In the framework of this exemplary system^ the pre-operation input to 

the system comprises images of a body part, for example the heart area of patient, 
taken by an MSCT scanner (not shown). The original images, as scanned by tiie 
MSCT (also referred to as shces) are stored on a storage device 20, The additional 
images and information storage 30 stores imag^ and other information produced 

10 by processing the origiixal linages. This processing is initiated by the user's 
actions and is performed by the pre-operation work station 40. The angiogram 
and the 3-dimensional reconstmctions of vessels based on die angiograms, are 
used during the operation, by the during-operation work station 50 and are stored 
in the angiogram and 3-dlmensional reconstraction storage 80. Each of the pre- 

15 operation work station 40 and the during-operation work station 50 is. preferably a 
computing platform, such, as a personal computer, a mainframe computer, or any 
other type of computing platform that is provisioned with a memory device, a 
CPU or microprocessor device (not shown), and several I/O ports (not shown). 
Alternatively, the pre-operation work station 40 and the during-opCTation work 

20 station 50 can be DSP chips, ASIC devices storing the commands and data 
necessary to execute flie methods of the present invention, or the like. The pre- 
operation woik station 40 and the during-operation work-station 50 are further 
equipped with standard means for collecting input from the user and presenting 
die results 60 and 70 correspondingly. In the exemplary environment of the 

25 present application, these would usually conq>rise a keyboard, a pointing device 
such as a mouse, and a display device. The pre-operation work station 40 and the 
during-operation woric-station 50 can further include internal storage devices (not 
shown), storing the computer applicatioxis associated with the present invention. 
These storage devices can also serve as the original images storage 20^ the 

30 adxJitional images and information storage 30 and the angiograms and 3- 
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diemeosional reconstruction storage 80. The storage units 20, 30 and 80 can be 
magnetic tapes^ magnetic discs, optical discs, laser discs, mass-stoiage devices, or 
the like« The computer application associated with the present invention is a set of 
logically inter-related computer programs and associated data stmctures that 
5 interact to perform the tasks detailed hereinafter. The pre-operation work station 
40 and the during-operation work station 50 can be the same machine, separate 
machines and even different machines. Optionally, the pre-operation work station 
40 and the during-operation work station obtain the original images, or store and 
obtain the images and information from sources other than the original image 

10 storage 20, the manipulated images and info storage 30, and the angiograms and 
3-dienmsional reconstruction storage 80, such as a remote souix^, a remote or 
local network, a satellite, a floppy disc, a removable device and the like. 

Further note should be taken that the apparatus presented is exemplary 
only. In other preferred embodimoits of the present invention, the computer 

15 applications, the original images storage 20, the manipulated images and 
additional nifonnation storage 30, the angiograms and 3-dimensional 
rieconstractions storage 80, the pre-operation work station 40 and the during 
operation work station SO could be co-located on the same computing platfomL 
As a result, one of the I/O sets 60 or 70 >vill be rendered unnecessary. 

20 Referring now to Fig. 2 that shows the various modules that perform 

actions on the MSCT images, prior to an operation. It is important to get a 
good understanding of the features and tools available in the pre-operation stage, 
because the products of these tools are used in the during-operation stage detailed 
below. The pre-operation modules are divided into automatic modules 22 that do 

25 not require user interaction during dieLr work, and mixed modules 23, in which 
the system executes conomands in response to the us^'s actions and inputs. The 
usa: is typically a physician or a skilled technician. This division to automatic and 
mixed tools is for clarity reasons only, and does not imply order of activation, 
precedence or the like. The modules to "be activated and their order depend on the 

30 user's choice. In addition, software engineering considerations might cause some 
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functionality of certain modules to be called automatioally from other module. 
The products of all the modules of Fig. 2 are stores in the additional images and 
information storage 30 of Fig. 1 . 

The automatic modules 22 conqirise a number of inter-related 
5 computer implemented modules. The standard 3-D presentation tools module 220 
can be a computer program for presCTtmg 3-D images, provided by the MSCT 
manufactures and also by independent manufactores such as VITREA® 
manufactured by Vital Images, Plymouth, MN, USA. The data acquired by CT 
scanners is volumetric in nature, i.e. intensity information is associated with each 
10 volume unit, named voxel. Since each substance scanned has a specific range of 
intensity, the intensity data represents the conq>ositioa of the area scanned. The 
CT intensity is measured in Hounsfield Units (HU). This raw volumetric 
information enables the reconstmction of segmiented information, i.e. 
reconstmction of specific body parts and tissues. Thie presentation tools 220 
15 enable a number of processing and viewing options of thie scanned images. 

One option is to show visible two-dimensional or three-dimensional 
presentations of the models of various body parts and tissues, the models 
constructed fi-om at least two slices scanned by the device. Two-dimensional 
images include, for example, scanned slices. Three-dimensional images include, 
20 for example, images of surfaces, inoages of an arteries stmcture and the like. 
Another presentation option involves producing ne^ planar images, either 
parallel or at a predetermined angle to slices taken hy the imaging device. Yet 
another option is presenting a cross section of an artery, or even a sequence of 
such cross sections, tiius visualizing **fly through'*. 
25 One more option is to present one or more images in various layouts, 

such as presmting at least two adjacent images depicting the same or adjacent 
locations, presenting images in a temporal sequence, and the like. 

The above mentioned views, images, and tiheix combinations are stored 
ill die additional images and information storage 30 of Fig. 1 . 
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The lumen construction tool 221 can also be a computer program for 
constructing 3D images showing lumen, such as VTTREA® manufactured by 
Vital Images, Plymouth, MN, USA. The tool 221 reconstracts the vessels 
structure by tracking the lumen, i.e., the space inside die arteries. As mentioned 

5 earlier, blocked parts of small diameter vessels are unreachable. 

The plaque identification and classification module 223 identifies the 
various types of plaque that might be deposited in the blood vessels. This is 
enabled by the high spatial and temporal resolution of the MSCT device, 
relatively to single-slice CT scanners (the angiograms, although high-resolution, 

10 do not enable soft-tissues imaging). The detection of the sediment type is 
performed by traversing the data stracture represCTLtmg the lumCT and comparing 
the intensity data associated with the area adjacent to the lumen witii predefined 
intensity ranges. Thus, the detection of sediment is performed by "tracking" the 
blood vessels through the lumen stmcture constructed by the lumen construction 

15 module 22 1 as a road map, and comparing the values of the CT intensity foimd in 
the vicinity of the blood vessels to known ranges (after ignoring the values 
associated wifli die heart surfece). The following table lists exemplary ranges of 
values for each type of sediment: 


Sediment Type 

Intensity (HU) 

Lipid-rich (soft) plaque 

>==12 and <= 62 

Fibroid (intermediate) plaque 

50-130 

Calcified plaque 

120 <= 


20 


The table was presented by Stephen Schroder, Tiibingeii, at the " 
International Task Force for Preventioh of Coixaiary Heart Disease" Symposium, 
Scuol, February 23, 2003. 

As can be noticed fixim the table, some ranges of intensity can be 
25 interpreted in more tban one mode, hi such cases considerations of continuity 
with surrounding areas will be t^lied. 
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The blood vessels' walls construction module 223 retrieves the 
information about the blood vessels' walls that can be deduced &om the high- 
resolution CT slices. When using the MSCt technology, each pixel rq«resents a 
square with a side of 0.4mm m average. Due to rounding problems, at least two 
pixels are required in order to detect an edge in general and tiie wall of the blood 
vessel in particular. Thus, only blood vessels' walls tiiat are at least O.Smm wide 
can be recognized accurately. For blood vessels with thinner walls, rounding 
problCTis cause substantial . errors and inhibit the correct presentation. The 
information about the lumen, sediments, and vessels' walls combined together, 
provides an informative view of the blood vessels, and is stored in the additional 
images and information storage 30 of Fig. 1. 

The mixed (automatib and manual) modules 23 comprise a number of 
inter-related computer inq)lemented modules. The user inter&ce module 229 
presents the user with all the options he or she can chose from when working with 
the system The presentation of these options uses gr^hic, textual or any other 
means. When choosing a certain option, the system enables the user to make the 
relevant dioices, paform the relevant actions and store the results. For exanq)le, 
when users select the "check point definition" option, the system would allow flie 
user to define a check-point and assodate views tiierewitfa as is oqplained below 
in the description of the check-point definition and view preparation module 233. 

The parameter setup module 230 is used for setting system parameters 
and user preferences, such as color selection, prefrared layouts of images, 
numerical parameters and the like. Such parameters are used by both tiie 
automatic and tb& mixed took, both prior to and during the operation. The 
parameters and settings are stored in the additional images and information 
storage 30 of Fig. 1. 

The plaque width calculation module 23 1 enables the user to point at a 
specific location along a blood vessel, and have the system calculate the actual 
width of the plaque layers deposited at flie location; the actual width of the lumen 
at that location; and the percentage of stenosis, if any, at that location. Hie 
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Stenosis percentage is determined by 1 minus the ratio between the actual area of 
the cross section of the artery at the required location and the average area of the 
cross section along the artery. This average is determined from the graph 
representing the cross-section's area distally and proxiinally fix>m the required 
5 location. All mentioned information - the plaque width, the blood vessel's width 
and the percentage of stenosis are stored in the additional images and information 
storage 30 of Fig- 1. 

The plaque correction module 232 enables the user to manually change 
the type, size, density and shape of any plaque sediment recognized by the 

10 system. It also enables the user to add or remove indications for plaque. In 
particular, correction might be needed in areas suffering from the blooming 
effect, due to which heavily calcified areas appear outsized. This is caused by the 
reflection of x-rays from the calcified areas onto tibieir neighboring areas. This 
eflfect is automatically corrected in the during-operation system in tiie blooming 

15 effect correction module 254 of Fig. 3. This automatic correction can not be 
performed without additional images of the area, such as angiograms and 3- 
dimensional reconstructions from angiograms, which are usually available only 
Himng the operation. The user input is accqited through the use of the keyboard 
and the pointing deyice 60 of Fig. 1. The corrections to the plaque areas are stored 

20 in the additional images and information storage 30 of Fig. 1 • 

In the check-point definition and view preparation module 233 the user 
can designate any point in the heart area of the patient as a check-point Smce all 
acquired data carries volumetric information, each pixel seen in an original slice 
or on certain types of derived images can be uniquely identified with the 

25 corresponding location m the imaged volume. Clicking with the mouse or 
otherwise pomting at such point defines it as a check-point when the system is at 
the check- point selection mode. The user can then associate one or more views 
with each check-point The views can be originally acquired slices, any other 
views as described hereinafter in the description of the enhanced presentation 

30 module 235, or any combmation of the above. The user can also associate 
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reconunendations for preferred perspectives of the medical imaging device being 
used during the operation, for better view of the relevant area. The check-points 
and the views and recommendations associated with them are stored in the 
additional images and infomiation storage 30 of Fig. l.The check-points and 
5 associated views are used during the operation as will be explained in the 
description of the check-poiat identification and designated views presentation 
module 256 of Fig. 3. 

The non-flexible and curved areas marking module 234 eimbles the 
user to mark parts of blood vessels as non-flexible or curved. Due tp the 

10 volumetric information of the CT data, it is possible to mark a relevant area in an 
image, that is identify location of desired area in CT volume. The marking can 
take place on an original slice or volume, or on the visually presented product of 
processing. The marking is performed, for example, by designating two points 
along a blood vessel so that the part of the blood vessel between these two 

15 locations is marked as non-flexible. In another embodiment the user freely draws 
the curved line along which the blood vessel is curving. This option is particularly 
usefiil in the highly curved areas of the blood vessels, or in areas where blood 
vessels branch. As with the check-point definition module, the user can associate 
any desired views with the marked areas. The marked areas, their types and the 

20 associated views are stored in the additional images and information storage 30 of 
Fig.l. 

The ^ohanced presentation module 235 complements the standard 
presentation tools modiile 220. This module presents all the additional 
information deduced by the system aind indicated by the user using the automatic 

25 modules 22 and the mixed modules 23, oyer tiie views mentioned above in the 
standard 3-P presentation tools module 220. One typo of information included is 
the marking of the different types of plaque layers as deduced by the system in 
the plaque identification and classification module 222 and possibly corrected by 
the user in the plaque correction module 232. Such layers are typically indicated 

30 by using a designated color for each type of sediment, selected in the parameter 
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setup module 230. Other data include the designated check-points, and the non- 
flexible and curved areas of the blood vessels. Yet more data includes the 
numerical values obtained by the plaque width determination 231, including the 
width of the various plaque layers, the diameter of the blood vessel at the 
5 specified location, and the pirax^entage of stenosis in that location. The previous 
description relates to the modules and tools available during the pre-operation 
mode. Following are the methods and modules used during the operation, in order 
to fuse and present infoniiation gathered prior to and during the operation. 

In a typical non-limiting environment in which the disclosed invention 
10 is used, a patient is scanned by an MSCT imaging device, and the products of the 
scan are analyzed by a physician or a skilled technician. The results of the 
analysis can include a decision that the patient does need to undergo a 
catheterization, and the products of the pre-operation modules as d^cribed in Fig. 
2. 

15 The previous description relates to the modules and tools available 

during the pre-operation mode. Following are the methods and modules used 
during the operation, in order to fuse and present information gathered prior to 
and during the operation. None of the pre-operation preparations is mandatory. 
All required operations can be performed immediately before or during the 

20 operation. Once the catheterization is in progress, the operating physician takes 
angiograms of the patient The angiograms are taken at diiBFerent locations, 
perspectives and magnifications according to the physician's needs at any given 
moment during the operation. The angiograms locations and angles can also be 
determined prior to the operation by a planning system to get best view of the 

25 problem. The angiograms imdergo processing yielding 3-dimensional 
reconstructions. The disclosed invention uses images and products of images 
acquired prior to the operation, during the operation. These images and products 
are fused with images and products acquired during the operation. 
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Referring now to Fig 3 that shows the method used in the proposed 
invention for fusing the images and products acquired prior to the operation with 
the images and products acquired during the operation* 
The method conq>rises the following steps: 
5 In step 239 registration is carried out, meaning establishing 

transformation between objects detected in CT volume and in angiograms. 

In step 240, global registration is performed, ia which the best set of 
parameters defining projection of CT volume into angiographic image plane is 
recovered. The global registration can be carried out in a number of ways. The 
10 first way is the use of calibration devices or fiducials. Fiducials are screws or other 
small objects made of material visible and easily detectible bodi in tibie MSCT 
volume and in the angiograms, such as Titanium. The fiducials are attached to the 
patient's body and do not change location between the CT imaging and the 
catheterization procedure, therefore their location in the CT and on the angiogram 
15 disclose the transformation between the two coordinate firames. Another way of 
performing the global registration is by using the parameters supplied by imaging 
system. Yet another option for the global registration involves the usage of 
iterative process of imaging parameter recovering utilizing automatic detection of 
corresponding points in 3-dimensional volume and 2-dimensional projection. One 
20 variant of this process coirprises the steps of preparing a synthetic image based on 
projection of CT volume or information extracted firom CT volume with 
approximately known imaging parameters; matching of synthetic image with real 
angiogram using, for example, correlation technique; refinement of imaging 
parameters according to the found local displacements between the two images; 
25 and repeat the steps until the process converges to the best imaging parameters. 
Combinations of the abovementioned methods for tibe global registration can be 
applied as well. 

The global registration process yields for every voxel of CT volume, a 
unique location in the angiogr^hic image. In the opposite direction, generally 
30 every pixel in an angiogram can be mapped into straight line in volume. 
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However, if the pixel belongs to a detected feature in angiogram and is associated 
with certain voxel of the corresponding feature detected in CT volume, the 
correspondence for such pixiel is then established. Therefore, matching of 
corresponding features in 3 dimensions and 2 dimensions is an essential part of 
establishing a bilateral correspondence. Matching the features is possible due to 
the hierarchy structure and distinctive geometry of blood vessels, i.e. their shapes 
and intersections. If the blood vessels network was denser, such matching might 
not have been possible. Alternatively, if two corresponding pixels are identified in 
two different angiogramis then a 3-dimmsional location of a corresponding voxel 
can be also established. 

In step 241 a local registration is p^ormed which includes removal of 
residual discrepancy between corresponding features detected in CT and 
angiograms. Specifically, the tree of 3-dimensoinal centerlines of blood vessels 
extracted firom the CT data is matched with the two-dimensional tree extracted 
fi-om two-dimensional angiograms, including branch-to-branch matching on high 
level and point-to-point matching within each matched branches on low level. 
Based on die matching of the trees, the global transformation can be augmented 
with continuously changiDg local correction function. This correction allows the 
establishment of an exact transformation not only for die local features 
themselves, but also for neighboring areas. 

In step 242, the images and detailed information acquired prior to the 
operation are fused with the most updated visual information as acquired by the 
angiograms during the operatioiL The fiision process uses the transformation 
found in step 239. The data fusion process starts firom a tibree dimensional image 
created firom the CT data. The centerlines of the blood vessels are derived Scota 
the CT data. A fused model combine regions with dififermt resolutions. The 
lumen around the vessel centerlines is presented with its structure derived from 
the CT and the high-resolution details originating from angiograms, whereas 
surroimding areas are represented with Iowct resolution information as acquired 
by the CT. Data fusion also takes place when presenting a cross-section of an 
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artery. The approximate shape of the cross-section of the artery is known from 
the CT images, and so are the depositions of plaque. However, since the 
resolution of the CT is inferior to that of the angio, the vessels boundaries 
infomxation and numeric data, such as the area of the cross section are fused with 
5 the image and enhance it The lumen area at any location along the vessel (i.e., 
the area of the cross*section of the blood vessel) is taken from the angio 
information. When the CT cross-section of the blood vessel at the same location 
is zoomed in, the transitions between sediments areas around the lumen and the' 
lumen itself are fine-tuned to fit the lumen area as determined by the angio. An 

10 important addition of the angio to the image fusion is the detection of small 
vessels that are not seen in the CT, The 3-dimensional coordinates of these 
vessels are determined by the 3-dimensional angio system, and thus they are 
fused with the 3- dimensional CT image. 

Referring now to Fig. 4 that shows the options available to a user and 

15 method of the present invention during the operation. The activities associated 
with thiese options are performed by the during-operation work station 50 of Fig. 
1, during a medical operation, typically a catheterization. 

When the blooniing effect correction option 254 is used, the system 

corrects the errors caused by the blooming effect, due to which some calcified 
20 areas look larger in CT images than they should. The error is correctable since the 
angiograms do indicate the correct size of the lumen in areas in which die 
blooming effect in the CT data concealed the liimen. 

The check-iK)int idmtification and designated views presentation 
option 255, supports using the check-points defined with the pre-operation check- 
25 point definition and view preparation module 233 of Fig. 2. Whenever the 
coordinates of a check-pomt are included in an unage taken by the angiogram, the 
system automatically indicates the presence of a check-point and presents the 
views associated with a specific check-point at the pre-operation stage. The 
preseixce of a <dieck-pomt in the current angiogram is deterrmned by checking if 
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the coordinates of the check-point as projected onto the angio plane are within the 
boundaries of die aogio image. 

The enhanced presentation option 256 presents all the images and 
views described in the pre-operation enhanced presentation module 235 of Fig. 2. 
5 In addition, iq)-to-dLate angio data acquired dining the operation is fused with the 
pre-operation images and views to oreate high-resolution up-to-date three- 
dimensional images. In die following sections, describing the advanced 
presentation methods, it should be noted that when referring to an image, it is 
either an original ixnage acquired by a device, or a product of processing such 
10 images. For CT ixnages, such products include three-dimensional views of 
vascular trees, surfaces, and the like, plaque indications, check-point indications, 
measurements and the like. For angio images, the products include measurements, 
three-dimensional ixnages of vascular trees acquired from multiple angiograms 
and the like. 

IS In accordance with the preferred embodiment of the present invention, 

three dimensional fused images are presented, in which the ^skeleton'* or the 
geometry of tbe blood vessels tree, is taken from the CT images, and the exact 
measurements and loigh resolution presentation is dmved from the angio. Another 
contribution of the CT images to the ftision is the identification of plaque 

20 sediments. The fusion is performed as explained above in stqp 241 of Fig. 3, 
Another frision option involves presenting angio images view of 3-dimensional 
reconstructions with, plaque indications derived from the pre-pperation stage; The 
indicated plaque layers can incorporate the correction of the blooming effect 
present in the pre-operation stage, by the higher-resolution angiograms. Another 

25 example for ftised elements is the marking of non-flexible or curved areas of the 
vessels as defined in the non-flexible and curved areas marking itnoduie 234 of 
Fig. 2, on the angiograms. Yet another example is presenting the plaque layers 
dimensions, the blood vessel's diameter and the stenosis percentage, as enhanced 
during the operatiorx. 
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In accordance with another preferred embodiment of the present 
invention, images of bofli devices are viewed side by side. The images can depict 
the same area of the body, different views of the same body area, partly 
overlapping body areas or totally non-overlapping body areas. In another 
5 preferred embodiment, an image taken by one device depicting a certain area is 
bordered on one or more sides by one or more images of the other device, 
depicting areas which are neighboring the area depicted by the image of the first 
device* The effect of this type of presentation is a continuous view of an area, 
wh^e certain sub-parts of the area were scanned by one device and the other sub- 

10 parts were scanned by a second device. In yet ano&er preferred embodiment, 
images taken by a first device prior to the operation and images taken by a second 
device during the operation are presented one on top of the other where the top 
image is at least partially transparexit. In another embodiment an image acquired 
by one device, and a larger image acquired by another device are presented where 

15 the larger image is surrounding the smaller image. The two images can depict the 
same area of the body, neighboring areas or dififerent areas. 

The above shown exanqples serve merely to provide a clear 
understanding of the invention and not to limit the scope of the present invention 
or the clahns appended thereto. Persons skilled in the art will appreciate that 

20 different or additional modules and methods can be used in association with the 
present invention so as to meet the invention's goals. In particular, different 
methods of fusing and different fused elements can b^ 

The proi>osed apparatus and methods are iimovative in presenting 
dxiring an operation, images and products acquired prior to the operation and 

25 fusmg them with fanages and data taken du ri ng the operation. The apparatus also 
takes advantage of the developing technology of MSCT devices, which enables 
identification and classification of sediments in blood vessels in general and the 
coronary arteries in particular, and assessment of the percentage and shape of 
stenosis in these blood vessels. This facilitates better assessmait of the patient's 

30 status and aids in the planning and during the execution of a catheter 
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The proposed apparatus also &cilitates the construction of three- 
dimensional angio images without the intraractioo. of a human operator. This is 
performed by automatic registration of each angiogram to a two-dimensional 
projection of the CT data, and identifying objects appearing both in the 
5 angiogram and in the CT. This, in turn provides th.e matching between the two or 
more angiograms and enables three-dimensionial reconstruction from these 
images. 

Persons skilled in the art will i^predate that the present invention can 
also be used with other modalities, ?uch as MRI, once its resolution and scaiming 

10 rate enable the identification and classification of plaque. Plaque is identified by 
MR parameters like Tj, Ta. diffusion coefficient, and other MRI tissue 
characteristics. It is also possible to use more than one set of images, possibly of 
different modalities, prior to the operation, and take the advantages of each of 
them in order to accurately assess the status of the coronaries. For example, one 

15 possible combmation is a black blood MRI idaxtifying the plaque with bright 
blood MRI identifymg the lumen. Registration of black MRI vs bright MRI is 
done by using the imager common coordinate system. When fusing MR with CT 
images, the registration me&od of MR and CT is well known in the literature. 

It will be appreciated by persons skilled in the art that the present 

20 invention is not limited to what has been particularly shown and described 
hereinabove. Rather the scope of tiie present invention is defined only by the 
claims which follow. 
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CLAIMS 

I/we claim: 

L An apparatus for displaying an at least one first image, said first image is a 
product of processing an at least one second image taken by a first medical 
imaging device prior to a medical operation, the first image conq^rising 
infdraiation about areas having sediments, wherein during the operation, 
said first image is presented to a user of the system. 

2. The apparatus of claim 1 where the at least one first image is fused with an 
at least one third image said tihird image is a product of proc^sing an at 
least one fourth image taken by a second medical imaging device during the 
operation. 

3. The i^paratus of claim 2 fiirther comprising a computer program for: 

registt^on of images of the first and. second medical imaging 
devices; and 

fusing infomiation contained in and associated with products of 
processing images of the first and second medical imaging devices; and 

presenting an at least one combmaliori image, the combination 
image is selected firom the group consisting of: the at least one first image, 
the at least one third image, a combination of the at least one first and the 
at least one third images containing informatiori obt£uned fi-om the at least 
one first or the at least one second medical imaging devices, an image 
containmg mforaiation obtained fix)m the first axid second medical imaging 
devices. 

4. The apparatus of claim 2 further conq)rising a correction module to correct 
an at least one unaging error m the at least one second image, using the at 
least one fourth image acquired during the operatioiL 

5. The apparatus of claim 4 where the imaging error is characterized by an at 
least one calcified area of an at least one blood TOsel depicted outsized on 
an at least one image, said at least one image is a product of processing an 
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at least one ixnage taken by an at least one medical imaging device prior to 
an operation. 

6. The apparatus of claim 2 where the at least one first image and the at least 
one third image, are presented on the same location on the visual display, 
where the at least one first and the at least oae third images are at least 
partially transparent 

7. The apparatus of claim 2 where an at least one part of the at least one first 
image, and an at least one part of the at least oae third image are presented 
adjacent to each other. 

8. The apparatus of claim 2 where sediments foxm<l by processing the at least 
one first image are distinctively marked on the at least one combinatiQn 
image. 

9. The apparatus of claim 1 where sediments found by processing the at least 
one first image are distinctively marked on the at least one first image. 

10. The apparatus of claim 1 fiirther conq)rising a oxarking modxile for marking 
an at least one non-flexible part of an at least one blood vessel, on Ihe at 
least one first image. 

11. The apparatus of claim 2 fiirther comprising a nouurking module for marking 
an at least one non-flexible part of an at least one blood vessel, on the at 
least one combination image. 

12. The apparatus of claim 1 fiirther comprising a module for marking at least 
one curved part of an at least one blood vessel, on the at least one first 
image. 

13. The apparatus of claim 2 fiirther comprising a module for m^ 

one curved part of an at least one blood vessel, on the at 1^ one 
combination image. 

14. The apparatus of clahn 1 fiirther comprising a module for marking 
indications prepared prior to the operation, on thie at least one first image. 
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15. The apparatus of claim 2 further conqirising a xnodule for marking 
indications pr^ared prior to the operation, on the at least one combination 
image. 

16. The apparatus of claim 2 further comprising a module far indicating during 
an operation, perspectives determined prior to the operation, for a medical 
iTTiflging device, said perspectives to be used while taking images during the 
oi)eration. 

1 7. The apparatus of claim 2 further comprising a module for: 

identifying at least one point in an at least ome unage presented 
during an operation with an at least one check-point indicated prior to the 
operation; and 

presenting at least one image, associated prior to the operation with 
th& at least one check-point; 

18. The apparatus of claun 1 further con^rising a module for the setup of 
system and user prefereiices. 

19. The apparatus of claim 1 vrhccc the blood vessel is a coronary artery. 

20. The apparatus of claim 1 where the sediments are any one of the following: 
lipid-rich plaque, intermediate plaque, calcified plaque, tiirombi, cells or 
products of cells. 

21. The apparatus of claim 1 where the first medical imaging device is a multi 
slice conoputerized tomography device. 

22. The apparatus of claim 1 where the first medical imagins device is a 
magnetic resonance imaging device. 

23. An apparatus for detecting at least one part of at least one bipod vessel with 
sediments layers, firom an at least one first image acquired by an at least one 
itniagirig dcvico prior to an operation, the apparatus comprises: 

an identification module for identifying the at least one part of the at 
least one blood vessel, and within said part the sedixnents layers located 
thereiri;and 
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a y pflr l^'n g module for indicadng the at least one part of the at least one 
blood vessel and sediment associated therewith on an at least one second 
image oieated by processing images taken by a medical imaging device. 

24. The apparatus of claim 23 where the identification module is receiving: 

5 intensity values for at least one pixel of at least one image acqiiired 

by a medical imaging device; and 

at least one range of intensity values for at least one type of 
sediment 

25. The apparatus of claim 23 further con^rising a module for constructing at 
10 least one visual representation of the lumen of the at least one blood vessel. 

26. The apparatus of claim 23 further coiiq)rising a module for constructing an 
at least one visual representation of an at least one part of the wall of the at 
least one blood vessel 

27. The apparatus of claim 23 wherem parts of the at least one blood, vessel and 
15 the sediment submerged thearein are indicated using color-coding . 

28. The apparatus of claim 23 further comprising a width determination module 
for determining: 

the width of the sediments layers at a location along the at least one 
blood vessel; and 

20 the diameter of the at least one blood vessel at a locatioxi along the 

bloodvessel; and 

the percentage of stenosis of the at least one blood vessel at a 
location along the blood vesseL 

29. The apparatus of claim 28 where the widths of the sediment layers, the 
25 diameter of the blood vessel and the percentage of stenosis are indicated on 

.tibie at least one second image. 

30. The apparatus of claim 23 further conq>rising a module for indicating, in 
iBspohse to a user action, at least one part of an at least one blood vessel as 
non-flexible. 
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31. The apparatus of claim 23 further enabling comprising a module for 
indicating, in response to a user action, at least one part of an at least one 
blood vessel as curved. 

32. The apparatus of claim 23 further comprising a check-point definition, 
module for indicating, in response to a user action, a position within the 
body of a patient as a check-point and associate said check-point with an at: 
least one second image, or an at least one set of perspectives for the medical 
imaging device enq>loyed during the operation- 

33. The apparatus oiF claim 23 yfbexc the at least one second image depicts a 
three-dimensional view of the at least one part of the at least one bloota 
vessel. 

34. The apparatus of claim 23 where the at least one second image depicts aa at 
least one surface within the human body and an at least one blood vessel on 
saidsur&ce. 

35. The apparatus of claim 23 where the at least one second image depicts an a.t 
least one internal three-dimensional view of the at least one blood vessel. 

36. The apparatus of claim 23 where the at least one second image depicts a 
cross-section of the at least one blood vessel at a location along the bloo<i 
vessel, said cross-section comprising one or more of the foUowing: 1fa.e 
blood vessel's wall, the lumen of the blood vessel, sediments submerged on 
the blood vessel's wall. 

37. The apparatus of claim 23 further comprising a module for manuall^^ 
correcting the indications for sediments on images acquired prior to aoi 
operation and the products of said images, 

38. The apparatus of claim 37 where the correction includes chan^g the size 
or the sediment type of the indication, adding, or deleting indications. 

39. The apparatus of claim 23 where the blood vessel is a coronary artery. 

40. The apparatus of claim 23 where the sediments are any one of tiae 
following: Upid-rich plaque, interaaediate plaque, calcified plaque, thrombi, 
cells or products of cells. 
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41. The apparatus of claim 23 v^^ete the medical imaging device is a multi slice 
conqjuterized tomography device. 

42. The apparatus of claim 23 whrae ^e medical imaging device is a magnetic 
resonance imaging device. 

43. A method for displaying an at least one first image, said first image is a 
product of processing at least one second image taken by a first medical 
imaging device prior to a medical operation, the image comprising 
information about areas with sediments, during the operation. 

44. The mediod of claim 0 whrae the at least one first image is fused with an at 
least one third image which is a product of processmg an at least one fourth 
image taken by a second medical imaging device during the opraation, the 
method comprises the following steps: 

registering the coordinate systems of the first and the third images; 

and 

fusing inforination contained in and associated with the at least one 
first image and &e at least one third image; and 

presenting an at least one combination image, the combination 
image is selected &om the groiq> consisting of: the at least one first image, 
the at least one third image, a combination of the at least one first and the 
at least one third images containing mformation obtained firom the at least 
one first or the at least one second medical imaging devices, ah image 
containing information obtained firom the first and second medical imaging 
devices. 

45. The method of claim 44 wh«e the registration of the coordinate systeins 

comprises the following steps: 

global registration of Ae fictst unage and the third image; 

removal of local residual discrepancies by matohing 
corresponding feature detected in the first and the tiiird images. 
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46. The method of claim 45 where the global registratioii is based on 
comparing the coordinates of at least one fiducial as seen in the first and the 
third images. 

47. The method of claim 45 where the global registration is based on matching 
an at least one third image to an at least one projection of a tibree 
dimensional data obtained from the at least one first image prior to the 
operation. 

48. The method of claim 44 further comprising a step of correcting an at least 
one imaging error in the at least first image, using the at least one third 
image 

49. The method of claim 48 where the at least one imaging error is 
characterized by an at least one calcified area of an at least one blood vessel 
depicted outsized on an at least one product of processing of at least one 
image taken by a medical imaging device prior to an opexaAoh. 

50. The method of daim 44 wbexe tihe at least one first image and tiie at. least 
one third image, are presaoted on tilie same location on the visual display, 
where the fiist and the third images are at least partially transparent 

51. The method of claim 44 where at least one part of the at least one first 
image, and at least one part of the at least one third image are presented 
adjacent to each other. 

52. The method of claim 44 where sediments found by processing the at least 
one first image are marked on the at least one third image. 

53. The method of claim 44 fiirflier comprising a step of maridng at least one 
non-flexible part of an at least one blood vessel, on llie at least one first 
image. 

54. The method of claim 44 fiirther conq>rising a step of marking at least one 
non-flexible part of an at least one blood vessel, on the at least one tiiiid 
image. 

55. The method of claim 44 further comprising a step of marking at least one 
curved portion of an at least one blood vessel, on tiie at least one first image. 
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56. The method of claim 44 further comprising a step of maridng at least one 
curved portion of an at least one blood vessel, on Hie at least one third 
image. 

57. The method of claim 44 further comprising the steps of: 

identifying at least one point in an at least one image acquired 
during the operation with an at least one check-point mdicated prior to the 
operation; and 

presenting at least one unage associated prior to the operation with 
the at least one check-point 

58. The method of claim 0 where the blood vessel is a coronary artery. 

59. The method of 0 where the sediments are lipid-rich plaque, intermediate 
plaque, calcified plaque, thrombi, cells or products of cells. 

60. The method of 0 where the medical imaging device is a multi-sUce 
computerized tomography device. 

61. The meliiod of 0 where the medical imaging device is a magnetic resonance 
imaging device. 

62. A method for automaticaUy detecting an at least one area of an at least one 
blood vessel having sediment submerged thereto, said sediment is of one or 
more types, using at least one first image acquired by an at least one 
medical imaging device, the method con^aismg the steps of : 

identifying tiie at least one area of the at least one blood 
vessel witii sediments layers; and 

mdicating the at least one area on an at least one second 
image, said second image is depicting a product of processing the at 

least one furet image. 

63. The method of claim 62 where the identification step comprises the step of 
con^arihg tiie intensity value of an at least one pixel of an at least one 
image acquired by a medical imaging device to at least one range of 
intensity values for an at least one type of sediment 
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64. The method of claim 62 further conq)rising the step of constracting an at 
least one visual representation of the lumen of the at least one blood vessel; 

65. The method of claim 62 further comprising the step of constracting an at 
least one visual representation of an at least one part of m at least one blood 
vessel. 

66. The method of claim 62 where sedunents submerged in tiiie at least one 
blood vessel are indicated using color-codingi 

67. The method of claim 62 furtho: comprising the steps of determining any 
one of the following: 

the width of the sediment layers at a position along the at least one 

blood vessel; and 

the diameter of the blood vessel at a position along the at least one 

blood vessel; and 

the percentage of stenosis of the at least one blood vessel at a 

position along fbe blood vesseL 

68. The method of claun 67 further comprising the st^ of indicating on the 
second image the at least one width of the sedimients layers, the diameter of 
the at least one blood vessel and the percentage of stenosis. 

69. The method of claim 62 further conqprismg a step of marking on the second 
image, in response to a user's actions, at least one part of an at least one 
blood vessel as non-flexible. 

70. The method of claim 62 further coni|)rising a step of marking on the second 
image, in response to a user's actions, at least one part of an at least one 
blood vessel as being curved. 

71. The method of claim 62 further comprising a step of indicatmg on the 
second image, in response to a user's actions, a point within the body of a 
patient as a check-point and associate said check-point with an at least one 
image, said image is a product of processing images taken by a medical 
imaging device prior to an operation, or an at least one set of perspectives 
for the medical iniaging device employed during the opraation. 
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72. The method of claim 62 wherein the at least one second image depicts an at 
least one tbree-dimensional view of the at least one blood vessel 

73. The method of claim 62 where the at least one second image depicts an at 
least one three-dimensional surface within the human body. 

74.1110 method of claun 62 where the at least one second image depicts an 
internal three-dimensional view of a. coronary artery. 

75. The method of claim 62 where the at least one second image depicts a 
cross-section of the at least one blood vessel, at a location along the at least 
one blood vessel, said CTOSS-section conqnising any one of flie following: 
the blood vessel wall, the lumen of the blood vessel, sediment 

76. The method of claun 62 further comprising the step of providing a user 
with the option to manually correct the indications for sediments on images 
acquired prior to an operation and on the products of processing said 
images. 

77. The method of claim 62 where the correction includes any one of the 
following: changing the size or the sediment type of an indication, adding, 
or deleting indications. 

78. The method of claun 62 wh&xt the blood vessel is a coronary artery. 

79. The metiiod of claim 62 where the sedunents are lipid-rich plaque, 
intermediate plaque, calcified plaque, thrombi, cells or products of cells. 

80. The method of claim 62 where the medical imaging device is a multi slice 
computerized tomography device. 

gl.The method of claim 62 where the medical imaging device is a magnetic 
resonance imaging device. 

82 A method for automatic reconstraction of a three-dimensional object from 
two angiograms using mformation collected from a modality, the mefliod 
comprises tiie following steps: 

taking a first and a second angiograms of the required area 
from different persi»ctives; and 
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for the first and the second angiogram, obtaining a first and a 
second projected images by projecting data collected firom the 
modality on the same plane as the first and the second angiogram; 
and 

registration of the first and the second angiogram with the 
corresponding projected images by objects appearing in the first or 
the second angiogram and in the first or second projected image; 
and 

mutual co-registration of the first and the second 
angiograms; and 

detecting objects appearing in the first or die second 
angiogram and match with the corresponding objects in the first or 
second projected image; and 

deriving the three dimensional coordinates of the objects 
appearing in the first and the second angiograms; a^ 

constructing a three dimensional image of the required area 
fi-om the first and the second angiogram. 

83. The method of claim 82 wherein the modality is a conqjuterized 
tomography imaging device. 

84. The method of claim 82 wherein the modality is a magnetic resonance 
imaging device. 
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